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SUMMER SCHOOL PILOT 1982: FINAL REPORT SUMMARY 



MAJOR POSITIVE FINDINGS 



1. The summer school was very popular. A large number of students 
enrolled (1,193 for at least part of the program), attendance was 
high (94%), and staff and parents were enthusiastic about the pro- 
gram. • I 

2. Math units were mastered at an average level of 87%. This exceeded 
the objective of mastery of attempted units at an 80% level. 

3. In reading, 36 of the 37 units were mastered by at least 80%. of the 
students. Although the objective was that units would be mastered' 

. by 90%\of the students, these results show reasonably good mastery 
of reading skills by most students. 

4. In the fall of 1982, teachers rated the reading and math skills of 
1981-82 retainees who attended summer school as higher than the skills 
of those who did not. This was not true for 1980-81 retainees. 

5. In math concepts, 1981-82 retainees who attended summer school 
showed better gains than those who did not at grades two and 
five and six combined. 



MAJOR FINDINGS REQUIRING ACTION 



1. The attendance rates of a sample of summer school retainees did not ' 
change between 1981-82 and 1982-83. However, the students showed 
good attendance (about 95%) , which closely matches the average for 
the District overall. 

/ 

2. In reading, retainees attending summer school did not show better 
gains than those who did not. 

3. ' In math, the 1980-81 retainees who attended and those who did not 

attend summer school showed similar gains. The 1981-82 retainees 
who attended summer school showed better gains than those who did 
not in only two of ten comparisons of Math Concepts and Math Prob- 
lem Solving ITBS scores. 
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WHAT WERE THE MAJOR FEATURES OF AISD'S SUMMER PROGRAM? 



Austin's 1982 summer program provided 90 minutes of reading, 90 minutes 
of math, and 60 minutes for a snack break and community school activi- 
ties . Mastery learning was used in both reading and math. 

• The Chicago Mastery Learning System (CMLR) and cu.er 
supplementary materials were used, for the regular 
reading program. 

• Three classes of limited-English-proficient (LEP A 
and B) students received instruction in English and 
Spanish reading using a variety of materials. 

• Math for Everyone , Succeeding in Mathematics workbooks, 
calculator enrichment, and other materials were used in 
the math program. . * 

A total of 1,193 students were enrolled in the summer school and attended 
at least part of the five-week session. All students in grades one through 
six who had ever been retained were eligible to attend. Most of the 77 
teachers taught two reading or two math classes each day. 



WHAT DID SHORT-TERM RESULTS SHOW? 



Briefly, the shovt-tevm results were very positive. 

• Staff and parents were enthusiastic about the program. 

• Enrollment (1,193 for at least part of the session) and 
attendance rates (94%) were very high. 

• ' Math units attempted were mastered at an average level of 87%. 

This exceeded the objective of an average mastery level of 80% 
on skill units attempted. 

• In reading, 36 of the 3? units were mastered by at least 80% 
of the students. While this did not meet the objective of 
mastery of all units by 90% of the students, it does show 
reasonable reading progress by most students. 

• Fall teachers of 1981-82 retainees rated those who attended 
summer school higher in reading and math skills than those / 
who did not attend. This difference was not found for the/ 
1980-81 retainees who did and did not attend, however. 
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DID THE SUMMER SCHOOL AFFECT ATTENDANCE RATES? 



The attendance rates of a sample of retainees who attended summer school 
were checked for 1981-82, summer, and 1982-83. An equal number of stu- 
dents had shown increases or decreases in absence rates between 1981-82 
and 1982-83. 




39 ^ increased 



Figure 1. CHANGES IN NUMBER OF ABSENCES: 1981-82 TO 1982-83, 

Thus, the summer school appeared to have little impact on the attendance 
rates of these students. However, these students also did not appear to 
have an attendance problem, since their attendance (about 95%) closely 
matched the average rate for the District overall. 



WERE STUDENTS PROMOTED AFTER SUMMER SCHOOL? "* . 

Parents were informed that .promotion should not be. expected due to summer 
school attendance. A check was done to see if any of the 502 1981-82 ■ 
retainees who attended summer school had been promoted by March 2 983. A 
total of 26 students (5%) had been promoted. However, a higher percentage 
(13%) of those who did not attend summer school were promoted. 
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wiAt long-term impact did the summer school have on student achievement? 

Since 1981-82 retainees who attended summer school seemed to show better 
math and reading skills in the fallout 1980-81 retainees did not, analyses 
were done separately for the two groups. Matched groups were selected 
last fall based on sex, ethnicity, gitfde, age, Reading Total and Math 
Total ITBS scores from spring 1982, and 1981-82 program' service (Title I, v 
Title I Migrant, limited English proficient, and special education service). 
Regression analyses were generally done by grade for the skill areas empha- 
sized. Grades five and six were combined for 1981-82 retainees, and grades 
three-five ciombined for 1980-81 retainues due to small sample sizes. 

r. 

Reading 

Vocabulary was emphasized at grade "one and reading comprehension at grades 
two through six during summer school. Reading achievement of 1980-81 and 
1981-82 retainees who attended summer school did not differ significantly 
from those who did not attend in any of the 16 comparisons. Thus, the 
long-term reading objective of better performance by those attending summer 
school was not met. 

Math 

Summer school skills emphasized were math concepts and math problem solving. 
No significant differences were found for 1980-81 retainees who did and 
those who did not attend summer school in the skill areas emphasized. 

Two significant differences, in favor of 1981-82 retainees attending summer 
school were^fouftd in Math Concepts. Retainees in grades two. and five and 
six combined who attended summer school gained about one month more than 
those who did not. Retainees who attended and those who did not attend 
summer school showed similar achievement patterns in math problem solving. 

Thus, the math objective was met at grades two and five/six for 1981-82 
retainees in math concepts, but not at other grades or in math problem 
solving. 

Summary 

Thus, while short-term results showed good mastery of reading and math 
skills presented and better skills in the fall for 1981-82 retainees at 
least, very few favorable results were found over a one-year period. The 
most likely explanation is that five weeks is not long enough to impact 
retainees 1 long-term" achievement (especially in reading). It is also 
possible that the fall teachers were unable to capitalize on the extra 
skills students came in with in the fall, or that the ITBS tests used 
still did not match the summer school curriculum closely enough to measure 
gains in skills emphasized specifically. 
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DID EXTRA INFORMATION HELP ACHIEVEMENT? 



Two approaches were tried in 1982 to give teachers extra information on 
students' learning styj.es and needs before summer school t>egan. 

• One sample of students received home visits from the reading 
and math teacher pair. These provided information about 
student needs and built rapport with the family. 

• For another sample, the former teachers were called by the 
summer school teachers for more* information about student needs 
and styles. 

• Some students were in both groups. For the rest, no extra 
information was collected. ' 

} All students were to have a data card provided by the spring teacher list- 
ing basal placement and ITBS scores. However, all carcfs were not complete 
and students who enrolled after the regular school year was over usually 
did not have this card available. '* " 



Mean scores in reading and math for students receiving a home visit, tele- 
phone call,. home visit and call, or neither contact were examined. Compari- 
sons revealed that: 

• Students in both the home visit arfcl telephone call to former 
teacher groups seemed to show the best gains. 

• Students receiving just home visits showed better gains at 
a few more grades than those who just had the summer school 
and former teachers talk to one another by phone. 

• Students in either the home visit or phone call groups showed 
better gains than those with no extra contacts. 

Thus, extra information did seem to help teachers serve student needs a 
little better. 



DID FOLLOW-UP ACTIVITIES HELP STUDENT ACHIEVEMENT? 



^ 1 
Summer school students received either general or specific follow-up in read- 
ing and math after the regular session ended. 

• In reading, the general follow-up was a letter giving general 
ideas on how to help the child with reading for the rest of 
the summer. The specific follow-up group received this letter 
plus five fun readdftg?' activities for parents to do with their 
children weekly. 
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• In math, all students were allowed to take home their workbooks. 
The general follow-up group received a letter on the last day of 
class indicating activities parents could do with their children 
in certain areas. The specific follow-up group received this 
letter, ylus five sets of special instructions for workbook pages 
to complete weekly. 

Parent survey results (returned by 24% of the sample) indicated that those 
who received specific follow-up in math were more likely to complete the 
workbook pages. However, TIBS achievement scores in reading and math 
showed no difference in the gains of those who received general and struc- 
tured follow-up. The percentage of parents completing the assignments may 
ha|re been too small to impact the average gain for the entire group, or 
the follow-up may not have been extensive enough to have an impact on 
achievement. 
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Summer School Pilot 
Appendix A 
IOWA TESTS OF BASIC SKILLS (ITBS)* 



I 



*Subsection of ITBS appendix covering 
all analyses related to retainees. 
Complete report in: RETENTION AND 
PROMOTION: 1982-83 Final technical 
report (ORE Publication No. 82.42). 
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Brief description af cha taacruaanc t 

The ITD3 It a acandardlsed awlcipla-choice achlevaaenc cute baccery. leval 3 vu 
given co klad«/gartan acudtnci co neaaure ikilla In Che artia of liacanin* (aprihj 
only), language (fill And spring), and uch (ipring only). Leva la 7 *nd 8 were given 
Co gradae 1 and 2, reepecdvely, co aeaaure ekllla in che areas ot word aoalyal*, 
vocabulary, raiding cooprehenaion, apelling, such concepCe, euch problaaa, and oach 
compucacion. ITBS levele 9-K vara adainiacarad Co gradaa 3-8 wlch cba ceac level for 
acudanca in gradaa 4-6 choaan on cht baaia of chair pravioua achlevaaenc icoraa (wich 
Caacher raviaw). Levela 9-L4 includa aubcaaca in all Cha araaa menCibned for lavala 7 
and 8, excapc for word analyeia. In addicion, lavala 9-14 includa gubcaaci oeaauring 
caoicalLracion, puncruacion, usage, visual macerlala, and rafaranca mace rials, 

To whoa vaa cha inacrumanc adainl-icere^ ? 

All elemencary and Junior high acudanca, gradaa K-8. Special aducacion eCuduiCe vara 
exaapced aa par Board Policy 3127 and ica aupporCing adalnlecraciva regulacion, Scu- 
dencs of liniced Sngliah proficiency <UP) vara noc exeapc, buc could ba excused after 
one caac on which chey coula noc funcciou validly; Scoraa for acudanca who wart mono- 
lingual or doainanC in a languaga ochar C L a« English wara nop includad in cha acnool' 
or Olscrlcc summaries. 

Hov many ciaaa waa che lnacruaenc adalnls cerad ? 

Once co ea:h scudenc in gradaa 1-8, cvGce co acudanca in klndergarcan. 
gfhen vaa cha iztacruaenc adalnia cared ? 

iUndergarcen acudanca wara caacad cha waalc of Sepceaber 7-10. Tha valamanjUrr «choola 
adainis Cared che caac April 19, 20, and 21 Co acudanca in gradaa K-6. Scudenca in 
• gradaa 7 and 3 wast caacad on February 15, 16, and 17. Taaca wara adainiacarad in 
cha morning. Maka-upa wara adainiacarad cha week afcer cha regular caaCing. 

When vaa cha lnacruaenc adainiacarad ? 

•In aach AISD aleaentaxy and junior high echool, uaually in* cha acudanc'a ragular 
claaarooa* 

Who adainiacarad cha Inacnnenc ? 

* 

Claaarooo caachara in cha elemencary achoola. In cha junior hign achoola, cha 
counselor or principal adainiacarad cha caac ovar cba public addraaa ayacaa uaing 
capad diracciona provided by ORE. Taachara accad aa caac proccora in chair claaaroom 
ac chese achoola. 

Vhac craining did che adaiaiacracora hava ? 

Building Teac Coordinators participaced in planning aaaaiona prior co cha CaaCing. 
Taachar craining waa cha reaponaibilicy of tha Building Taac Coordinacor. However, 
caachar inaervlce craining vaa available frca ORE upon raquaac. Taachara and coun- 
aelora recaivad vrfccan inacrucciona from-ORE. fnc uding a checkliac of procetiurea 
and a acripc co. follow U\ cast adainiacracion. 

Wara char a problems wich cha inaCrumanc or che admlnlacracion chac nlghc affecc 
cha valid lev o^ che daca ? 

Mo known problaaa wich nhe inacruaanc. Problems in cha adainiacracion ara doouaancad 
in cha aonicors' reporta which are Available ac ORE. 

Vho developed che lnacruaenc ? 

The I'niversicy of Iowa. The IT3S ia publiahed by che Riveraide Publiahing Company. 



Vhac reliability and validity daca are avallabla on che Inatrumenc ? 

The rai Lab ill r/ of individual aul ceaca and area cocals, aa summarized by Kuder- 
Richardaon Formula 20 coeff icier. ., rangea froa .75 Co .97, across ceac levela. 
Ccerficienca for che Cecal baccery range froa .94 co .99, acroaa ceac. lavala. S^ui- 
valinc-foraa reliabllicy coefficienca, calculacad for gradea 3-3, range froa .71 co 
.92, acroaa aubcaacs and area cocala. The issues of concenc and conacrucc validicy 
are addreaaed in che publiaher'a preliminary cechnical summary, pp. 13-15. 



Are chere nora iaca available tor incerprecing che resulca ? 

*>fara daca ara available in che Teacher's 3uide. The Teacher's Culde providea eapiricai 
aoraa (grade equivalenc, percencile, a canine) for che fall and apring. rncerpolaced 
uoraa are available for aidyear. tfacional. large cicy, and achool building norms are 
available. 
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Purpose * 

Iowa Tests of Basic Skills (ITBS) results provided information relevant to 
the following decision and evaluation questions: * 

. Decision Question D2 : How effective have efforts- been directed tbwards 
retainees? Should they be continued and/or modified? ° 

Evaluation Question D2-4 : How did the achievement of retainees 
who did and did not attend summer school compare on emphasized 
math and reading skills? 

Evaluation Question D2-5 : ■ Did the achievement of summer school 
retainees who received home visits, phone calls to former teachers, 
or no extra contacts differ on skills emphasized? ■ ' s v ' 

Evaluation Question D2-6 : Did the achievement of summer school 
students who received follow-up activities ' in the mail differ 
from other students on skills emphasized? ' * 

Procedure 

. Because 1981-82 retainees who attended summer: school seemed to, show better 
; math, and reading skills in the fall but 1980-81 retainees did not, analyses 
were done separately for the two groups Matched groups were selected 
last fall based on sex, ethnicity ,. grade, age, Reading Total and Math 
Total scores from spring 1982, and 1981-82 program service (Title I, Title 
I Migrant, limited English proficiency, and special education, service) . 

Regression analyses were generally done by grade. However, grades 5 and 6 " 
were combined for 1981-82 retainees and grades 3-5 were." combined for 1980^81 
retainees, because of ' small sample sizes. ' • 

The skill areas .emphasized in reading were vocabulary and word-attack skills 
at grade 1 and comprehension at "grades 2 through 6- Therefore, ITBS^ Vocab- 
ulary and Reading Comprehension scores were checked at the appropriate grade 

• Math Problem Solving arid Math Concepts ITBS scores were analyzed in math, 
since these were the skills emphasized. Mean scores in Math Computation 
were also calculated. 

Figure numbers in this appendix begin with A-l 6 because summer school anal- 
yses .represent one part of a larger ITBS "appendix discussing all retention 
analyses found in : the overall technical report on retention: 
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Results 

SUMMER^SGHOOL FOLLOWUP - 

Decision Question D2 : Sow-effective have -efforts been' directed towards V 
retainees? Should, they be continued and/or modified? 

Evaluation Question D2-4 : How did the achievement of retainees 
who did and did not attend summer school compare on emphasized 
math and reading skills? 

Because 1981-82 retainees who attended summer school seemed to show better 
reading and math skills in the fall but 1980-81 retainees did not, analyses 
were done separately for the two groups. In reading, Vocabulary scores 
were examined at grade one through six as the skills emphasized. Math 
skills emphasized were those tested by Math Problems and Math Concepts on 
.the ITBS. . 

1981-52 Retainees 

Reading : Five regression analyses in reading revealed no. significant 
differences between 1981-82 retainees who attended summer school and those 
who did not. A linear relationship was found between pre- and posttest 
scores. The gains of 1981-82 retainees who attended summer school ranged 
in size from .49 (at grade four) to 1.17' (at grade six) GE years. Third- 
and fourth-grade gains were considerably smaller than those made at - the 
other grade levels. 

Math. No significant differences were found in math problem solving skills 
based on ITBS scores. Gains for retainees who attended summer school 
ranged from .52 (at grade four) to 1.04 (at grade three) grade equivalent 
years (see Figure A-17). 

Two significant differences in favor of retainees who attended summer 
school were found in Math Concepts. On the average, retainees who attended 
summer school after repeating second grade gained. about .87 GE years com- 
pared to .74 GE years for those who did not. For students with low pre-\ 
test scores, retainees who attended summer school showed better gains than 
those who did not. At grade five/six, retainees who attended summer school 
gained .58 GE years compared to .52 GE years for those who did. not (see 
Figure A-18). Retainees who attended summer school with higher pretest 
scores showed better gains than those who did not attend. Both the slopes 
and intercepts for the two groups at grades two and four differed. Line 
plots are shown in Attachment A-5 r A linear relationship was found between 
pre- and posttest scores in both math concepts and problem solving." 
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Math Computation was not emphasized during summer school but scores are 
shown in Figure A-19 for informational purposes. Ret;ainees who attended 
summer school' at grades one, two, and three, appeared to have slightly 
higher (one to* two months) mean GE scores than those' who did not. These 
may or may not be significant differences. Students who attended. summer 
school gained about .67 GE years overall in Math Computation while those 
who did not gained about .61 GE years. 
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Figure A-16. , READING ITBS SCORES FOR }981-82 RETAINEES. Mean grade equivalent 
'• scores for students taking the 1978 version of the" -ITBS (Form 7) 

are shown. The top half shows information for 1981-82 retainees 
V\ (retained in' spring 1982) who attended summer school; the bottom • 

ERJC,. half focuses on those who did not attend, SSPP refers to the 

1 Summer School Pilot Project. 
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Figure A-17. MATH PROBLEM-SOLVING SCORES FOR 1981-82 RETAINEES. Mean grade equivalent 
. scores on the 1978 ITBS Form 7 are shown for those who attended and did 
not attend summer school. 
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Figure A-18. MATH CONCEPTS SCORES FOR 1981-82 RETAINEES. Mean GE scores on the ITBS (1978 Form 7) ? 1 
are. shown for those attending and not attending summer school. . 
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Figure A-19. MATH COMPUTATION ITBS SCORES. Mean grade equivalent scores for students' taking 
Form 7 of the ITBS (normed in 1978).- Scores for retainees attending and not 
attending summer school are shown, 
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1980-81 Retainees 

Regression analyses for the skills emphasized were also run for the 1980-81 
retainees who did and did not attend summer school.. Analyses were carried 
out for grades one, two, and three-five combined. None of the 1980-81 
retainees who had scores available were in the sixth grade. 

No significant differences were found in either reading or math' between 
the groups. All sample sizes were small (6 to '33 per group) so gains 
varied widely by grade. Scores are shown in Figures A-20 through A-23. 
The chart below shows the range of mean gains made by those who did and did 
not attend summer school who were retained at the end of the 1980-81 school 
year. 





1980-81 RETAINEES- 


-MEAN GAINS IN GE'S 


Area 


* Attended Summer School 


Did Not Attend Summer School 


Reading 


.29-1.63 


.12-. 87 
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Problem- 
Solving 


.45-. 82 


.0-1.66 
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Concepts 


.60-1.12 
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Summary 

Overall, the summer session appeared to have little long-term impact on stu- 
dent achievement — at least as measured by the ITBS. There is some indicatio: 
that math' concepts skills were improved slightly. Since 1981-82 retainees 
who attended summer school did appear to have better skills than those who 
did not based on teacher judgements in the fall, it may be that this advan- 
tage was largely lost during the year. Five weeks may not be long enough to 
have an impact on long-term achievement, or the ITBS subtests chosen may not 
have matched. the curriculum closely enough to be sensitive to the change. 
The impact on math concepts may reflect the greater time spent on math rela- 
tive to the regular school year per day. Reading scores 'also tended to be 
somewhat lower initially, which could have made it a little more difficult 
for teachers to impact skills in five weeks. Reading is generally more dif- 
ficult to remediate based on AISD's high school tutorial classes. 
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Figure A-20. MATH CONCEPTS SCORES FOR 1980-81 RETAINEES. Mean GE scores on Form 7 of 
the ITBS (1978) for those attending and not attending summer school are 



shown. 
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Figure A-21. ' MATH PROBLEM-SOLVING SCORES .FOR 1980-81 RETAIKEES ON THE ITBS FOR THOSE ATTENDING AND 
' NOT' ATTENDING SUMMER SCHOOL, 'Form 7 of the ITBS "fined in 1978 was given in April of 
both years. Mean grade equivalent scores are shown. 
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Figure A-22, MATH CONCEPTS SCORES FOR 1980-81 RETAINEES, Mean GE .scores on Form I of "the' 
ITBS (1978) for those attending and not attending summer school are shown. 
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Figure A-23. MATH COMPUTATION SCORES FOR 1980-81 RETAINEES, Mean GE scores on Form 7 of the 
ITBS (1978) for those attending and not- attending summer school are shown, 
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Reading' Objective 

As of April 1983, retainees participating in 'the 1982 summer' school will 
show higher achievement in reading areas emphasized than will retainees 
who did not participate based on the Iowa'Tests of Basic Skills (ITBS). 

i 

JThi^ objective was not met. Retainees who attended summer school did not 
,show "Highef-achi-evemen-t~ in~r.eading^skill^©mg^sijje^ compared to those who 
did not based on spring 1982 and 1983 ITBS score's. " ' 

Math Objective 

As of April 1983, retainees participating in the 1982 summer school will 
show higher achievement in math areas emphasized than will retainees who 
did not participate based on the Iowa Test of Basic Skills (ITBS). 

Retainees who attended summer school scored. higher than those who did not 
in Math Concepts at grades two and five-six. They did not score higher in 
Math Concepts at grades one, -three, and four. fl 

Retainees who attended summer school did not show significantly higher 
achievement in Math Problem Solving than those who did not at any of the 
grade levels. * 



Spanish Reading 

It was hoped that the summer school would improve LEP participants 1 
ability to read in Spanish. This was difficult to measure for several 
reasons : 

• The Prueba de Lectura, a Spanish. Reading test, is given 
each spring but only to students in grades two through. 

• Only nine of the 3'9 LEP summer school participants had 
pre- and posttest scores, 

• Any gains made by^tlie^sunrmer ' school participants, from 
spring to spring are probably due to a combination of 
summer school and regular school-year instruction.. 

• A good comparison group is not available, in that scores 
are only reported for all students tested each, year at 
each, grade. Scores are not reported on a pre- and post- 
test basis. Also, scores are reported separately for. 
those LEP students who did and who did. not receive 
Spanish instruction during the year. It is not known 
whether the summer school participants received this 

'instruction or not during the regular school year. 

Given these precautions, the best comparison available seems to be that 
of LEP summer school students' versus Spanish-dominant students who 
received Spanish instruction during the regular school—year v : — — 
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Figure A-24. 


PRUEBA DE 


LECTURA SCORES FOR 


1981-82 AND 1982-83. 



Raw scores are shown for those attending summer 
school with pre- and posttest scores (SS) and all 
those receiving Spanish instruction during the 
regular school year (All) . 



._Although..-extreme-„caution„mus.t-.ba._taken in interpreting these scores, this 
information overall suggests that LEP students in summer school scored 
closer to average after the program. The only grade at which this pattern 
does not hold is for those in grade three in 1982-83. 

LEP Ro.ading and Math - 

No formal objective was set for English reading ability, but the general ' 
questions of interest were: Iftat were the average GE scores of retainees 
in summer school in April 1982 and April 1983? How did they compare to 
those of all LEP retainees? Was there an increase in the number of these 
students able to take the ITBS in 1983 compared to 1982? 

There were three classes of LEP A and B students in the program. Reading 
for these students was a separate curriculum for Spanish reading and English 
as a Second Language. Math for Everyone (in English) and the rest of the 
regular math program were used. One bilingual teacher taught both reading 
and math to the students and helped the children by telling them what the 
English directions were in Spanish. One class operated basically at the 
kindergarten level, one at grade one, and one at an intermediate level 
(grades four - six). 

Very few students 'had Reading Total and Math Total scores on a pre- and 
posttest basis, but those that are available .are shown in Figure A-25. 
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It is difficult to compare these scores to those .of all LEP students by 
grade since summer school grade assignments did not necessarily match 
regular school year assignments. However, a look at overall scores 
across grades suggests that: 

• LEP students who attended summer school scored below the 
average for all LEP retainees in spring 1982. 

• Summer School LEP - s tuden ts- s tlll_ s.co.r.eJie lbw the LEP 

retainee average in 1983, but close the gap somewhat irTthe 
reading area (but not in math), * ' 
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Figure A-25. SUMMER SCHOOL LEP A AND B STUDENT SCORES. 

Reading Total and Math Total mean GE , 
scores on the 1981-82 (Pre) and 1982-83 
(Post) ITBS. 
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One final measure of improved English skills was the ability of these 
students to take the' ITBS. Teachers have the option of exempting stu- 
dents from taking the ITBS after they have attempted one subtest 
(usually in. math) if they feel the students 1 command of English is not 
great enough to handle the remaining tests. A check was made to see 
how many valid scores were available for these students in reading. 
Overall-, there- was an increase from 10 students with 1981-82 scores to 
23 students with 1982-83 scores. Thus,' it appears that these students did 
show some improvement in their command of the English language. How much 
of this improvement is due to summer school^ is impossible to say. , 

Evaluation Question D2-5: Did the achievement of summer school retainees 
who received home visits, phone calls to. former teachers, or no extra 
contacts differ on skills emphasized? 

Before summer school began, teachers called the former teachers of about 
half of the students and visited the homes of about one fourth of the stu- 
dents. These groups were randomly selected, so some students fell in both 
groups. About one fourth had no contacts made. The home visits and phone 
calls to former teachers were, designed to give the summer teacher more 
information about the students' needs and interests, and build rapport with 
the homes. 

Teachers reported completing about two thirds of the randomly assigned 
phone calls and 98% of the assigned home visits. Incomplete calls or 
home visits were included in the group receiving "neither" contact. 

Figures A-26 and A-27 show the reading and math scores of summer school 
students in the areas emphasized. 

In reading, students whose teachers both called former teachers and visited 
the home seemed to show better gains at grades 1, 3, and 5/6. Those receiv- 
ing just home visits showed the best gains at grade two and those receiving 
just phone calls gained the most at grade four. The group which had no con- 
tacts did not show the best gains in any case. 

In math concepts, students who had both a home visit and call to the former 
•teacher showed the best gains at grades 1,2, and 5/6. Those receiving just 
home visits, and those receiving no visit or call made the best gains at 
grade 4, while those receiving no visit or call showed the best gains at 
grade 3. r In math problem solving, those receiving home visits showed' the 
best gains at grades two and three, those whose former teachers were called 
did best at grade one, those receiving, home visits or both did best at 
grade four, and those receiving both did best at grade 5/6. 

Thus, those students for whom teachers had additional information did seem 
to irake slightly larger gains in reading and math. A phone call to the 
former teacher and a home visit seemed to have the most impact (eight 
cases), followed by home visits only (five cases), and phone calls only 
(two cases). There were only two cases in which the group for which the 
teachers had no advance information did as well or better than the other 
groups . 
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'VOCABULARY (1ST) AND HEADING COMPREHENSION 
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Figure A-26. READING SCORES FOR THOSE RECEIVING CONTACT BEFORE SUMMER SCHOOL. ITBS mean grade 
equivalent scores are shown for the reading areas emphasized in summer school- 
• vocabulary (V) at grade 1 and reading comprehension (RC) at grades 2-6, 
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Evaluation Question D2-6 ; Did tho achievement of summer school students 
who received follow-up activities in tho mail differ from other students 
on skills emphasized? 

Follow-up activities were designed to provide additional practice in reading 
and math for summer school retainoos for the rest of tho summer. Classes 
were randomly assigned to receive a general or specific form of followup to 
allow comparisons of effectiveness. 

In reading, the "general" follow-up group received a letter giving general 
idea3 on how to help the child with reading the rest of the summer. Tho 
"structured" group received this letter plus five weekly fun reading activi- 
ties for parents to work on with their children. In math, all students were 
allowed to take home their workbooks. The "general" follow-up group received 
a letter on the last, day of class indicating recommended activities in spe- 
cific areas to work oriin the workbook. The "structured" group received 
this letter plus five weekly letters with specific instructions for workbook 
pages to work pn. 

It should be noted that all students were assigned to a group but about one- 
third of the parents said they had received no follow-up information in at 
least, one area. Since parent surveys were anonymous, the groupings shown 
in Figure A-28 are based on those assigned to receive structured or general 
followup. The fact that some parents reported that they had not received 
the materials must be considered in interpreting results. 

Parent, survey results indicated- that those who received specific followup 
in math were more likely to complete workbook pages' than those who received 
general or no followup. 
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Figure A-28 shows the mean grade equivalent scores in reading areas emphasized 
Tumraer school for those assigned to receive general and specific followup. 
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Figure A-28. 



ITBS READING SCORES FOR SUMMER SCHOOL 'RETAINEES 
RECEIVING STRUCTURED AND GENERAL. FOLLOWUP ACTIVI- 
TIES. Mean grade equivalent scores are shown for 
areas : emphasized in the summer program — vocabulary 
at grade 1 (V) and reading comprehension "(RC-) at 
grades 2-6. Fifth and sixth graders used the same 
materials and were often in the same classrooms. 



Gains for the two groups appear to be quite similar except at grade 3-where 
the general followup group appeared to gain more. Thus, those who received 
structured followup activities 'for five weeks .did not appear to. gain any 
more than the other students in the reading areas emphasized. 
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MATH PROBLEM SOLVING 
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Figure A-29. 
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scores are shown for the two areas emphasized in the 
summer program. 



As these charts reveal, gains in math problem solving were similar for the two 
groups at grades one and two, greater for the general group at grade three, and 
greater for the specific follovup group at grades four and five/six. In math, 
concepts, gains were similar for the two groups at all grade levels. 
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Data Description: Costs 
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COSTS 



Purpose "' 



Finance figures provided information on how much the 1982 summer school 
cost overall, by funding source, and by student. A list of consultants 
used was also compiled from Finance figures. 



Procedure 

Finance supplied the Department of Federal and State Compliance with final 
budget figures. One of the grant planners compiled the figures and calcu- 
lated per pupil costs. Per pupil costs are based on the 1,193 students 
served during at least part of the program. Figures could also be based on 
the June 14, 1982 enrollment figure of 1,064 students if desired ($248.63) . 
Evaluation costs of $7,458.01 were excluded from the per pupil cost. The 
evaluator compiled a list of all consultants used and the amount they were 
paid . 



Results 

Austin's 1982 summer school for retainees cose $272,006. The Austin ISD 
spent $191,639 in local and $80,367 in TEA funds on the program.* The "pet 
pupil cost (excluding evaluation expenses) was $221.75 based on 1,193 stu- 
dents served (see Figure B-l) . Figure B-2 shows consultants used during 
the 1982 summer program.* A total of $3,024.23 was spent, primarily to pay 
observers. *■ ' 
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III. Project Expenditures: Report whole dollar enounte only. 



Cost per pupil = $2ZU5 
based on $264,547.99 in expenditures 
(excluding $7,458.01 in ^valuation 
costs) and 1,193 students served during 
at least part of the sunnier program, 
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, Program Description 

The 1982 summer school for retainees, conducted from June 7 to July 9, 
1982, enrolled 1,193 students in grades one through six for at least part • 
of the session. Sites were Becker, Brooke, Cook, Maplewood, and St. Elmo 
elementary schools. -These students were served by 77 teachers for an over- 
all ratio of 15.5 students for each teacher. 

Enrollment was originally to be done at the regular 1981-82 schools until 
mid-May with an opportunity to sign up on the first day at the summer 
school campuses on a "first come, first served" basis based on space 
available. It was felt, however, that it was important that all retainees 
from 1981-82 or previous years be served no matter when they enrolled. 
Enrollment was therefore opened indefinitely. The response to the program 
was greater than expected and the original estimate of 900 students to be 
served at three campuses was exceeded. Brooke and Becker were added as ' 
summer school campuses about three weeks before classes began. 

The school day lasted from 8:30 - 12:30 and consisted of one-and-a-half 
hours of reading/language arts, one hour of recreational activity (snack, 
restroom break, and. a community school activity of the student's choice), 
and ^one-rand- a- ha If hours of math/applied skills. 

Summer school teachers telephoned one-half of their students 1 former 
teachers to obtain information about the students 1 skills.. A sample of 
children's parents were visited by summer school teachers to establish 
rapport between school and home. , Follow-up activities were conducted in 
which parents were sent letters about xvorkbook assignments or exercises to 
be completed during the five weeks folding the end of summer school. 

Summer school teachers were selected on the. basis of length of their 
experience with the District, length ..of experience at their grade level, 
recommendations by instructional coordinators and principals, and lack of 
experience teaching in previous summer schools. After being selected and 
accepting their assignments, two in-service sessions were held: one, a 
.general overview of the program held at the central administration building, 
and a second dealing with specifics of the local program and assignment of 
students to classes held at the local campuses. The general overview ses- 
sion was done twice to accommodate staff added late. 

What did the math curriculum include? 

I; . 

The math materials ( Math for Everyone ) were developed by the Educational 
Service Center, Region XIII, and. were supplemented by a workbook ( Succeed - 
ing in Mathematics )-. Hispanic students of Limited English Proficiency (LEP) 
received instruction in Spanish using the same materials. Calculators and 
other enrichment materials were also used. 
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The Math for Everyone series contains a "scope and sequence' 1 plan for each 
grade level. Specific instructional objectives are provided with the 
scope and sequence and are grouped according to instructional "strands." 
Teachers were to give priority to problem solving and .numeration, and to 
teach geometry and measurement as time permitted. 

Originally, students were to be assigned specific strands based primarily 
on their performance on the Iowa Tests of Basic Skills (ITBS) and/ or the 
Texas Assessment of Basic Skills (TABS). The information actually used to 
make these decisions included ITBS subtest scores in reading and math, 
reading basal and math text .levels completed, previous, teacher recommenda- 
tions made by telephone, parent ideas based on home visits, and informal 
assessments done by the. summer school teacher. 

Th£ curriculum was to be taught as follows: 

• 5-10 minutes: group motivational activities. 

© 30 minutes:, large group instruction using Math for Everyone . 

• 30 minutes: small group instruction/independent practice 

using the Succeeding in Mathematics workbook. 

• 20 minutes: enrichment, using calculators and teacher 

resource books.' 

After completing instructional activities for a unit, students were to be 
given a "formative" test. Students were required to answer 80% of the 
items correctly to "master" eaxh skill. Students achieving mastery were to 
work on enrichment activities while .those who did not received additional 
instruction on the same skill unit and were retested with a "summative" 
test. 

Information regarding whether the sequence of math instruction was imple- 
mented as planned was gained from three observers with a combined total of 
108 hours of observation in summer school math classrooms. Observers were 
asked what the typical sequence of math instruction was. . All three agreed 
that generally teachers asked questions, had students practice math skills 
independently, reviewed math skills with students after practice, gave work- 
book assignments, and then engaged in enrichment activities. The daily 
"group motivational activities" originally planned did not occur every day. 
The test-retest sequencing was not as obvious to the observers during the 
last two weeks as it was during the beginning. Testing did occur, however, 
and teachers 1 records were checked during the program to make sune they were 
being kept correctly. There seemed, to the observers, to be less enrichment 
activity occurring in first- and second-grade classrooms; Overall, the 
observers did not notice any great systematic differences between the planned 
t and actual math program. Most math teachers (65%) responding to the Teacher 
Survey said the materials should be used again. 
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What did the reading curriculum include (including materials and equip- 
ment)? 

The reading materials ( Chicago Mastery .Learning Reading-CMLR ) were 
developed by the Board of Education of the City of Chicago /and published 
and supported by Mastery Education of Watertown, Massachusetts, 

At the first-grade level, about half of the CMLR time was to be spent in 
developing word attack/study skills, while the other half was to be spent 
in improving comprehension skills. At grades two through six, -comprehen- 
sion was to be the main emphasis. 

CMLR materials were to c; be presented initially to the entire group. Within 
each unit, skills were sequenced so that each subskill would be mastered 
before moving to theenext. As in the math program, students were to be 
given a fbrmative test on the unit on which they received instruction. 
Students answering at least 80% of the items correctly were to receive 
CMLR enrichment activities, while those who did not were to receive "cor- 
rective" instruction, after which they were again tested. Students avail- 
able for enrichment activities could also be available as a peer tutor for 
students needing more remediation or could read a book from the Reading is . 
Fundamental program. A student must have attained 80% correct on the'sum- 
mative test to have mastered the skill unit. For those not achieving this 
criterion, review material was built into the next unit. ; 

CMLR was to be used for one hour. For the other half hour, miscellaneous- 
activities related to language arts could be undertaken: journal writing, 
library visits, independent reading, story reading in a group, were*all 
suggested activities. 

Impressions of the observers were that teachers most often spent the non- 
CMLR time reading aloud. This was supported by Teacher Survey results, 
on which 77% of teachers reported spending at least ten minutes a day in 
reading aloud during non-CMLR time. Other activities mentioned by teachers 
were: independent reading, phonics instruction^ and vocabulary instruction. 
Materials from Scholastic (Text Extenders), Modern Curriculum Press (Grade 1 
and Houghton-Mifflin (Grades 2-6) were used for reading activities. About 
80% of the reading teachers judged the quality of the materials to be good 
or excellent, and 77% responded that the material should be used again. 

Hispanic students with Limited English Proficiency (LEP) in categories A 
and B were not instructed with the CMLR materials, but were given instruc- 
tion in Spartish reading, oral language development, vocabulary (on Monday, 
Tuesday, and Wednesday), and English as a Second Language ' (ESL) (on Thurs 7 
day and Friday), using the following materials: Elena y Dani , Caracolitos , 
Stepping Into English , I Like English Teaching Cards , Language Visuals , and 
Scholastic Colleccidn . 

What community school activities, were offered? 

Offerings varied by campus. Generally, a variety of arts , -crafts , table 
games, and physical education (indoor and outdoor) were; available. Some 
campuses offered .creative dramatics and .typing. The community school also 
staffed school libraries so they could be open. il 
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How many students were promoted after attending summer school? 

An extra breakdown was done to see if the promotion rate was higher for 
those ateending the- 1982 summer school or not by March 1983, Figure Ol 
shows the results,. 
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Figure C-l, PROMOTION RATES FOR 1981-82 RETAINEES 
WHO ATTENDED AND DID NOT ATTEND SUMMER 
SCHOOL, Figures are based on all stu- 
dents still on the Student ! Master File 
as of March 1983. Figures include eight . 
students on AISD Student Master but in 
Austin private schools. 

Thus, 26 (5.2%) of the 502 1981-82 retainees who' attendee} summer school were 
promoted. However, 97 (12.6%) of the 767 1981-82 retainees who did not 
attend summer school were promoted. The stfurce of this difference in pro- 
motion rate is not clear. It could be that those who went to summer school 
were the, lowest achievers, or that parents of those who attended summer 
school did not push for promotion because they had been told summer school 
would not lead to it. "* 
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Instrument- Description: Attendan ce Registers 
3ri«f dtscrlscisn pjg tha ins cr.imBp.c } 

The inacrumenc is i compucer-generaced form by school wich che Use of scudencs co be 
checked ac chac school and space to record che number of days enrolled and che number 
of iays absonc for each of five si;<-veek periods and overall, The infonru\cion vas 
caken from che accendanca registers ac each of che schooLs in che sample. 

To vhoa vas the instrument administered ? 

The instrument vas adminiscered by ORE scaff wich che help of che person tn charge of 
keeping che accendance registers ac che school, 

3ow =any timss vas the inssruaenc admini3 cered ? 
Once. 

Vhen vas the inscrumer.t administered ? 

The Last veek in April and the first veek in May. 
Where vas che inscrumer.t administered ? 

Ac Allan, 3arringcon, 3rown, Brentvood, Oak Hill, Pecan Springs, Rosevood , Zilker , 
Cock, Sunsec Valley, and Kaplewood. 

Vho administered the instrument ? 

The evaluation assistant for District Priorities. 

What training did che administrators have ? 
Verbal inscriptions . 

Vas the instrument admj.nistarad ur.dar standardised tor.ditions ? 
N'Op although all registers are to be kept in a scandard way. 

Were there -problems, vith the instrument or the administration that might aifecc 
the validity of tna iata? " " ~ ' ' ~ 



Who developed the ins t r*m< 



District Priorities' evaluaccr. 



Are thera 



iata available for interpreting the results? 
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Attendance Registers ' 

\ 

Purpose ^ 

... 1 \ 

The purpose of this appendix is to provide information to answer the follow- 
ing decision and evaluation questions from the' 1982-83 Retention/Promotion 
Evaluation Design: \ 

\ • 

Decision Question D2 : ,How effective have\efforts been directed 
towards retainees? Should they be continued and/or modified? 

Evaluation Question D2-3 : What were the attendance rates of 
1981-32 retainees who attended summer school during 1981-82, 
summer school, and 1982-83? 

TEA requested this information to determine whether summer school attendance 
had any impact on retainees' attendance. 



Procedure 

The study started with the random selection of ten schools. The schools 
selected were. Allan, Barring ton, Brown, Brentwood, Graham, Oak Hill, Pecan 
Springs, Rosewood, Summit t and Zilker. Sunset Valley^ Cook, and Maplewood 
were later added to the sample. Once the schools were chosen the next step 
was to find retainees for whom the needed attendance information was avail- 
able. T^he" students selected met the following criteria: chey attended one 
of the schools selected in April 1983, and they had summer school attendance 
data and attendance data for 1981-82 available from summer school records. 

Grahan. and Summitt had no summer school retainees who had complete attendance 
data available. Sample sizes at the other schools were also reduced because 
of- this. Information from 1981-82 was often missing. A small number of 
students had also left AISD by April 1983. The total number of students 
checked was 84. . 

The form used to gather the data was developed by a District Priorities 
evaluator and generated by ^the AISD computer. The forms are by school with 
the list of students to be checked at that school and space to. record the 
number of days enrolled and the number of days absent for each of the five 
six weeks and for the total number of days enrolled and absent (see Attach- 
ment F-l). ■ ■ "v v . 
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The procedure for getting the information was to have the evaluation 
assistant/ for District Priorities call each of the schools and either 
arrange a time when she could come out to the schools and gather the 
information or get the information over the telephone. Getting the 
information by telephone was done when there were three or less students 
per school. In one case the list was sent to the school and the person 
in charge of the attendance register filled in the information and sent 
it batik to the office. If a student had just transferred, we called the 
previous school if the school registrar knew what it was. 

/ 

/ Results 

The average number of days enrolled and absent for retainees in the sample 
spools are shown in Figure F-l. The average absence rates were 5.12 for 
41I of 1981-82, 5.2% for summer school, and 4.9% for the first five six 
weeks of 1982-83. Since absence rates typically increase, slightly the' 
last six weeks of the school year, absence rates seem fairly stable over- 
all for the three periods. 

Another check was made to see how many students" attendance had increased 
or decreased by more than .1% from 1981-82 to 1982-83. The number of 
absences went up for 33 students (39.3%), down for 33 students (39.3%), 
and did not change more than 1% for 18 students (21.4%) > (See Figure F-2) . 

Thus, summer school appeared to have little impact on the attendance of 
these students. Average attendance rates changed only slightly from 
1981-82 to 1982-83, and equal numbers of students* attendance increased and 
decreased. These results must be interpreted in light of District atten- 
dance rates. The average absence rates were 6% in 1981-82 and 5.4% for the 
first five six weeks of 1982-83. The average absence rate for 1982-83 over- 
all was 5.5%. Thus, the retainees who attended summer school appeared to 
have average. attendance— they did not miss school. any more often than other 
AISD students. 




Figure F-2'. PERCENT OF STUDENTS FOR WHOM THE NUMBER OF ABSENCES 
VARIED OR STAYED THE SAME FROM 1981-82 TO 1982-83. 
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